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Basic National Fee by 30 months; 

4. A copy of a petition to revive filed by our office on April 4, 2002, in which we 
erroneously paid the remainder of the filing fees; 

5 . A copy of the Decision on Petition under 37 CFR 1 . 1 37(b) mailed June 26, 2002, 
which indicates that the petition to revive was granted. 

Applicant submits that the basic national fees were correctly paid upon filing the national 
phase application, and requests that the Notice of Abandoimient be withdrawn and the additional 
fees which were paid in error to be credited to us. 

Please apply any charges or credits to Deposit Account No. 06-1050. 



Respectfully submitted, 




Fish & Richardson P.C. 
500 Arguello Street, Suite 500 
Redwood City, California 94063 
Telephone: (650) 839-5070 
Facsimile: (650) 839-5071 



50099064.doc 



i5Tfl6Rec'dfi 



suBSTmrre form pto-i39o 



J U.S. DEPARTMEk commerce PATEffT AND TRADEMARK OFFICE 



TRANSMITTAL LETTER TO THE UNITED STATES 
DESIGNATED/ELECTED OFFICE (DO/EO/US) 
CONCERNING A FILING UNDER 35 U.S.C. 371 



- 25 JUL m 



Al fORNEY'S DOCKET NUMBER 
09872-002003 



U.S. APPLICATION NO. (If Known, see 37 CFR 
1.5) 



INTERNATIONAL APPLICATION NO. 
PCT/USOO/1547 



INTERNATIONAL FILING DATE 
21 January 2000 



PRIORITY DATE CLAIMED 
21 January 1999 



TITLE OF INVENTION 

UNIVERSAL INTERFACE FOR VOICE ACTIVATED ACCESS TO MULTIPLE INFORMATION PROVIDERS 



APPLICANT(S) FOR DO/EO/US 

Paul Edmonds. Yi Zhang. Chang Xu. Priyen Doshi, George Soliman. Andy Chan> Michael P. Tel. David Weinstein and Stephen Co 



Applicant herewith submits to the United States Designated/Elected Office (DO/EOAJS) the following items and other information: 

1. 13 This is a FIRST submission of items concerning a filing under 35 U.S.C. 371. 

2. □ This Is a SECOND or SUBSEQUENT submission of items concerning a filing under 35 U.S.C. 371 . 

3. □ This is an express request to promptly begin national examination procedures (35 U.S.C. 371(f)). 

4. S The US has been elected by the expiration of 19 months from the priority date (PCT Article 31). 

5. A copy of the International Application as filed (35 U.S.C. 371(c)(2)) 

a. □ is attached hereto (required only if not communicated by the International Bureau). 

b. □ has been communicated by the International Bureau. 

' c. S is not required, as the application was filed in the United States Receiving Office (RO/US). 

6. □ An English language translation of the Intemational Application as filed (35 U.S.C. 371(c)(2)). 

7. □ Amendments to the claims of the Intemational Application under PCT Article 19 (35 U.S.C. 371(c)(3)) 

a. □ are attached hereto (required only if not communicated by the Intemational Bureau). 

b. n have been communicated by the Intemational Bureau. 

c. □ have not been made; however, the time limit for making such amendments has NOT expired. 

d. □ have not been made and will not be made. 

8. □ An English language translation of amendments to the claims under PCT Article 19 (35 U.S.C. 371(c)(3)). 

9. □ An oath or declaration of the inventor(s) (35 U.S.C. 371(c)(4)). 

10. □ An English language translation of the annexes to the International Preliminary Examination Report under PCT 

Article 36 (35 U.S.C. 371(c)(5)). 

Items 11 to 16 below concern other documents or information included: 

11. □ An Infonmation Disclosure Statement under 37 CFR 1.97 and 1.98. 

12. □ An assignment document for recording. A separate cover sheet in compliance with 37 CFR 3.28 and 3.31 is 

included. 

13. El A FIRST preliminary amendment. 

□ A SECOND or SUBSEQUENT preliminary amendment. 

14. □ A substitute specification. 

15. □ A change of power of attorney and/or address letter. 

16. S Other items or information: 

13 Check in the amount of $100.00 

K Return Postcard 

□ 

□ 



CERTIFICATE OF MADJNG BY EXPRESS MAIL 

Expreu Mill Label No. EL 631 196 961 US 

July 23. 2WI 

Date of Deposit 



■ ' A 


U.S. APPUCATION NO. (IF KNOWN) W 1 IN 1 bRNAI lONAL APPLICATION NO. 
-.- J 1 PCT/USOO/1547 


ATTORNEY'S DOCKET NUMBER 
09872-002003 


17. □ The following fees are submitted: 

Basic National Fee ( 37 CFR 1.492(a)(1)- (5) ): 

Neither international preliminary examination fee (37 CFR 1 .482) 
nor international search fee (37 CFR 1.445(a)(2)) paid to USPTO 
and International Search Report not prepared by the EPO or JPG $1000 

International preliminary examination fee (37 CFR 1.482) not paid to 

USPTO but International Search Report prepared by the EPO or JPO $860 

International preliminary examination fee (37 CFR 1.482) not paid to USPTO but 
international search fee (37 CFR 1.445(a)(2)) paid to USPTO $710 

Intemational preliminary examination fee paid to USPTO (37 CFR 1.482) 

but all claims did not satisfy provisions of PCT Article 33(1 )-(4) $690 

Internationa! preliminary examination fee paid to USPTO (37 CFR 1.482) 

aiiu ail wiaiiiio ociudiicu piuvisiUflo \Jl i /\rLIUlC OO^ 1 ) \^) ^jUv 

ENTER APPROPRIATE BASIC FEE AMOUNT = 


CALCULATIONS PTO USE 
ONLY 


$100.00 




Surcharge of $130 for fumishing the oath or declaration later than □ 20 □ 30 
mor)ths from the earliest claimed priority date (37 CFR 1.492(e)). 


$0.00 




/ Claims 


Number Filed 


Number Extra 


Rate 




Total Claims 


-20 = 




x$18 


$0.00 




Independent Claims 


- 3 = 




x$80 


$0.00 




MULTIPLE DEPENDENT CLAIMS(S) (if applicable) 


+ $270 


$0.00 




TOTAL OF ABOVE CALCULATIONS = 


$0.00 




□ Applicant claims small entity status. See 37 CFR 1.27. The fees indicated above are 
reduced by 1/2. 


$0.00 




SUBTOTAL = 


$0.00 




Processing fee of $130 for fumishing the English Translation later than □ 20 □ 30 
months from the earliest claimed priority date (37 CFR 1 .492(f)) 


$0.00 




TOTAL NATIONAL FEE = 


$0.00 




Fee for recording the enclosed assignment (37 CFR 1.21(h)). The assignment must be 
accompanied by an appropriate cover sheet (37 CFR 3.28, 3.31). $40.00 per property + 


$0.00 




TOTAL FEES ENCLOSED = 


$100.00 






Amount to be 
refunded: 


$ 


Charged: 


$ 



a. ^ Having met the criteria set forth under 37 CFR 1 .494, a check in the amount of $100. 
37 CFR 1 .492(a)(4), is enclosed. 



00, as designated by 



NOTE: Where an appropriate time limit under 37 CFR 1,494 or 1.495 has not been met, a petition to revive 
(37 CFR 1.137(a) or (b) must be filed and granted to restore the application to pending status. 



SEND ALL CORRESPONDENCE TO: 



Hans R. Troesch 
FISH & RICHARDSON P.C. 
2200 Sand Hill Road, Suite 100 
Menio Park. CA 94025 
(650) 322-5070 phone 
(650) 854-0875 facsimile 



SIGNATURE : J 






Katherine Kellv Lutton 


NAME 






46.333 



REGISTRATION NUMBER 



50054786.doc 



( 




.ey's Docket No.: 09872-002003 



•4 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

Applicant : Paul Edmonds et al. Art Unit : Unknown 

Serial No. : As yet unknown Examiner : Unknown 

Filed : July 23, 2001 

PCT Serial No.: PCT/USOO/1547 

PCT Filing Date: 2 1 January 2000 

Title : UNIVERSAL INTERFACE FOR VOICE ACTIVATED ACCESS TO 
MULTIPLE INFORMATION PROVIDERS 

Commissioner for Patents 
Washington, D.C. 20231 

PRELIMINARY AMENDMENT 
Prior to examination, please amend the application as follows: 

In the claims : 

Please cancel claims 1-4, 41-46, 51, 53 and 57-60. 
Please amend claims 5, 47, 49, 52 and 54-55. 

5. (Amended) A universal interface for accessing one or more information systems 
from a user telephone, the universal interface comprising: 

an input converter for converting input from the user telephone to commands; 

an interface control module coupled to the input converter for receiving the commands 
from the input converter; determining one of the information systems to be accessed; converting 
the commands to commands recognizable by the inforaiation system; forwarding the converted 
commands to the information system; receiving data from the information system; detecting the 
form of the data from the information system; and storing information relating to a current state 
of the system; 

a speech-to-text routing switch coupled to the interface control module for receiving data 
from the information system and control data from the interface control module; 

a speech-to-command converter coupled to the interface control module for converting 
speech to commands, wherein the speech-to-command converter is coupled to the speech-to-text 
routing switch to receive speech and to forward commands to the interface control module; 
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an output switch coupled to the interface control module and the speech-to-text routing 
switch for receiving speech from the speech-to-text routing switch for receiving a control input 
from the interface control module, and for forwarding speech from the speech-to-text routing 
switch to the user telephone; and 

a text-to-speech converter coupled to the output switch for receiving text from the 
interface control module, converting the text to speech, and forwarding the speech to the output 
switch to deliver speech to the user telephone. 

6. The universal interface of claim 5, wherein the user telephone is a mobile 
telephone. 

7. The universal interface of claim 5, wherein the input converter comprises a 
speech-to-command converter. 

8. The universal interface of claim 5, wherein the input converter comprises a tone- 
to-command converter. 

9. The universal interface of claim 5, wherein the interface control module integrates 
the data from the information system periodically or manually under user control, the interface 
control module further comprising: 

means for retrieving data from the information systems; 
means for determining antecedent comparable relevance of the data; 
means for updating all of the data to reflect the most recent data; 
means for linking relevant data; and 

means for exporting the linked data to the information system. 

10. The universal interface of claim 9, wherein the information systems comprise two 
or more of the following: 

a calendar; 
a to-do list; 
an address book; 
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voice mail; 
e-mail; and 
a web site. 

1 1 . The universal interface of claim 5, w^herein the interface control module integrates 
and synchronizes (i) a database of a personal information manager, (ii) a database residing on a 
personal digital assistant, and (iii) a database residing in the universal interface, the universal 
interface coupled to a computer on which the personal information database resides, wherein a 
computer further comprises: 

a first input terminal for receiving data from the personal digital assistant; 

a second input terminal for receiving data from the universal interface; 

a sensor for detecting a synchronization event triggered by a user requesting 
synchronization of the database of the personal digital assistant with the database of the personal 
information manager; 

an electronic mail system coupled to the Internet; and 

control logic coupled to receive the synchronized event from the sensor and to transmit 
data, over the electronic mail system, to the interface control module, wherein the control logic 
updates the data in each of the databases to reflect the most recent data entered into any database. 

12. The universal interface of claim 1 1 , wherein the synchronization information is 
sent to the universal interface in its entirety, in compressed form, or in incremental form. 

13. The universal interface of claim 5, wherein the data sent from the information 
system to the universal interface is sent over the Internet. 

14. The universal interface of claim 13, wherein the data sent is encrypted. 

15. The imiversal interface of claim 5, wherein the output switch fiirther comprises: 
a detector for determining whether the speech from the speech-to-text routing switch is 

digital or analog; 

a sound card coupled to the detector to receive digital data; 
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a first speech routing switch for receiving a control input from the detector, and speech 
fi"om the detector or speech fi*om the sound card; 

a second speech routing switch for receiving the control input firom the interface control 
module and speech from the first speech routing switch or speech firom the text-to-speech 
converter, the second speech routing switch forwarding speech to the user telephone. 

1 6. The universal interface of claim 5, wherein the information system comprises at 
least one of: a dual tone multiple fi-equency (DTMF) driven voice mail system, a voice driven 
voice mail system, an electronic mail system, a web site, and a personal information manager. 

17. The universal interface of claim 5, wherein the system determines one of the 
following: 

whether the voice conunands are being received fi-om a user telephone; 
the information system to be accessed; 

whether the voice commands, after being converted to commands, are recognizable to the 
information system; 

whether the converted commands have been forwarded to the information system; 
whether data has been received fi-om the information system; 
whether data fi"om the information system is speech or text; 
the state of the speech-to-text routing switch; and 
the state of the output switch. 

1 8. The universal interface of claim 5, wherein the interface control module further 
comprises: 

a model for converting commands fi-om the telephone into commands recognizable by the 
information system; and 

a translator coupled to the input converter for retrieving the model corresponding to the 
information system to be accessed and for converting the commands to commands recognizable 
by the information system. 
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19. The universal interface of claim 5, wherein the universal interface further 
comprises: 

means coupled to the input converter for signaling that the user telephone has received 
unintelligible words; 

means for restarting communication to the text-to-speech converter at a point a specified 
number of words back from the point at which the communication ceased; 

means for forwarding the first specified number of words by spelling the words out; and 
means for contmumg forwarding the data after the specific number of words. 

20. The universal interface of claim 5, wherein the universal interface fiirther 
comprises: 

means for detecting a first language in which the commands firom the user telephone are 
received; 

means for detecting a second language associated with the data received from the 
information system; and 

means for converting the data from the information system into the first language. 

2 1 . The universal interface of claim 20, wherein the universal interface fiirther 
comprises means for detecting more than one languages within a single fragment of data. 

22. The universal interface of claim 5, fiuther comprising a resource manager for 
establishing conference bridges to an external telephone having a telephone number, wherein: 

the interface control module detects, from the commands from the input converter, 
whether a conference bridge request has been made; 

the interface control module retrieves the telephone number of the extemal telephone to 
establish the conference bridge; 

the interface control module forwards the telephone nxxmber to the resource manager; and 

the resource manager establishes a telephone connection with the extemal telephone. 
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23. The universal interface of claim 5, further comprising a facsimile manager for 
sending facsimiles to one or more facsimile machines, wherein: 

the interface control module detects, from the commands from the input converter, 
whether a facsimile request has been made; 

the interface control module retrieves a telephone number of a designated facsimile 
machine; 

the interface control module forwards the data and the telephone number to the facsimile 
manager; and 

the facsimile manager faxes the data to the designated facsimile machine. 

24. The universal interface of claim 5, wherein the universal interface further 
comprises a pager manager for sending pager messages to one or more pagers, wherein: 

the interface control module detects, from the commands from the input converter, 
whether a pager request has been made; 

the interface control module retrieves data to be forwarded to the pager; 

the interface control module retrieves a telephone number of a designated pager to which 
the data is to be forwarded; 

the interface control module forwards the data and the telephone number to the pager 
manager; and 

the pager manager forwards the data to the designated pager. 

25. A universal interface for accessing data from one or more information systems 
comprising: 

an input converter for receiving inputs from the user telephone and converting the inputs 
into commands; 

an interface control module coupled to the input converter comprising: 

means for periodically requesting data from the information systems; 

means for retrieving data from the information system; 

means for detecting the form of data from the information system; 
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means for converting the data that is speech to commands; 
means for storing the data for later access by a user telephone; and 
means for storing information representing a current state of the system; and 
further comprising: 

means for receiving commands from the input converter and means for detecting 
which of said stored information is sought to be accessed; , 

a text-to-speech converter coupled to the interface control module for receiving said 
requested stored text from the interface control module, converting the text to speech, and 
forwarding the speech to the user telephone. 

26. The universal interface of claim 25, wherem the user telephone is a mobile 
telephone. 

27. The universal interface of claim 25, wherein the input converter comprises a 
speech-to-command converter. 

28. The universal interface of claim 25, wherein the input converter comprises a tone- 
to-command converter, 

29. The universal interface of claim 25, wherein the interface control module 
integrates the data from the information system periodically or manually under user control, the 
interface control module fiirther comprising: 

means for retrieving data from the information systems; 
means for determining antecedent comparable relevance of the data; 
means for updating all of the data to reflect the most recent data; 
means for linking relevant data; and 

means for exporting the linked data to the information system. 

30. The universal interface of claim 29, wherein the information systems comprise 
two or more of the following: 

a calendar; 
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a to-do list; 
an address book; 
voice mail; 
e-mail; and 
a web site. 

3 1 . The universal interface of claim 25, wherein the interface control module 
integrates and synchronizes (i) a database of a personal information manager, (ii) a database of a 
personal digital assistant, and (iii) a database residing in the universal interface, the universal 
interface coupled to a computer on which the personal information database resides, said 
computer comprising: 

a first input terminal for receiving data from the personal digital assistant; 

a second input terminal for receiving data from the universal interface; 

a sensor for detecting a synchronization event, wherein the event is triggered by a user 
requesting synchronization of the database of the personal digital assistant with the database of a 
personal information manager; 

, an electronic mail system coupled to the Internet; and 

control logic coupled to receive detection information from the sensor and to transmit 
data, via the electronic mail system, to the interface control module, wherein the control logic 
updates the data in each of the databases to reflect the most recent data entered into any one 
database. 

32. The universal interface of claim 3 1 , wherein the synchronization information is 
sent to the universal interface in its entirety, in compressed form, or in incremental form. 

33. The universal interface of claun 25, wherein the data sent from the information 
system to the universal interface is sent over the Internet. 



Attorney's Docket No.: 09872-002003 



34. 

encrypted. 



The universal interface of claim 33, wherein the data sent over the Internet is 



Applicant : Paul Edmonds et^^ 
Serial No. : As yet unknown 
Filed : July 23, 2001 
PCX Serial No.: PCT/USOO/1547 
PCT Filing Date: 21 January 2000 
Page : 9 



AttClTiey's Docket No.: 09872-002003 



35. The universal interface of claim 25, wherein the information system comprises at 
least one of: a dual tone multiple frequency (DTMF) driven voice mail system, a voice driven 
voice mail system, an electronic mail system, a web site, and a personal information manager. 

36. The universal interface of claim 25, wherein the system determines one of the 
following: 

whether the voice commands are being received from a user telephone; 
the information system to be accessed; 

whether the voice commands, after being converted to commands, are recognizable to the 
information system; 

whether the converted commands have been forwarded to the information system; 
whether data has been received from the information system; 
whether data from the information system is speech or text; 
the state of the speech-to-text routing switch; and 
the state of the output switch. 

37. The universal interface of claim 25, wherein the interface control module ftirther 
comprises: 

one or more models containing commands recognizable by the information system; 

control logic for accessing the model that corresponds with the information system to be 
accessed, converting control commands to commands recognizable by the information system, 
and forwarding the converted commands to the information system. 

38. The universal interface of claim 25, wherein the universal interface ftirther 
comprises: 

means coupled to the input converter for signaling that the user telephone has received 
imintelligible words; 

means for restarting commimication to the text-to-speech converter at a point a specified 
number of words back from the point at which the conmiimication ceased; 

means for forwarding the first specified number of words by spelling the words out; and 
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means for continuing forwarding the data after the speciJBc number of words. 

39. The universal interface of claim 25, wherein the universal interface further 
comprises: 

means for detecting a first language in which the commands firom the user telephone are 
received; 

means for detecting a second language associated with the data received firom the 
information system; and 

means for converting the data from the information system into the first language. 

40. The universal interface of claim 39, wherein the imiversal interface fiirther 
comprises means for detecting more than one language within a single fragment of data. 

47. (Amended) A method for providing data from one or more information systems 
to a user telephone, comprising the steps of: 

converting speech from the user telephone to text; 

determining the information system to be accessed; 

converting the text to commands recognizable by the information system; 

forwarding the converted commands to the information system; 

receiving data from the information system; 

detecting the form of the data from the information system; 

converting non-speech data from the information system into speech; 

forwarding the speech data to the user telephone; 

storing information relating to the current state of the system; and 

integrating and synchronizing (i) a database of a personal information manager, (ii) a 
database of a personal digital assistant, and (iii) a database residing in a universal interface, by: 
receiving data from the personal digital assistant; 
receiving data from the imiversal mterface; 
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detecting a synchronization event, wherein the event is triggered by a request for 
synchronization of the database of the personal digital assistaiit with the database of a personal 
information manager; 

transmitting data, via an electronic mail system, to the interface control module; 

and 

updating the data in each of the databases to reflect the most recent data entered 
into any one database. 

48. The method of claim 47, wherein the synchronization information is sent to the 
xxniversal interface either in its entirety, in compressed form, or in incremental form. 

49. (Amended) The method of claim 48, further comprising sending the data from 
the information system to the universal interface over the Internet. 

50. The method of claim 49, further comprising encrypting the data from the 
information system before sending the encrypted data over the Internet. 

52. (Amended) A method for providing data from one or more information systems 
to a user telephone, comprising the steps of: 

converting speech from the user telephone to commands; 

determining the information system to be accessed; 

converting the text to conunands recognizable by the information system; 

forwarding the converted commands to the information system; 

receiving data from the information system; 

detecting the form of the data from the information system; 

converting non-speech data from the information system into speech; 

forwarding the speech data to the user telephone; and 

storing information relating to the current state of the system, wherein storing 
information relating to the current state of the system further comprises the steps of determining; 
whether the voice commands are being received from a user telephone; 
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the information system to be accessed; 

whether the voice commands, after being converted to text, have been converted 
into conmiands recognizable by the information system; 

v^hether the converted commands have been forwarded to the information system; 
whether data has been received from the information system; 
whether data from the information system is speech or text; 
the state of the speech-to-text routing sv^tch; and 
the state of the output switch. 

54. (Amended) A method for providing data from one or more information systems 
to a user telephone, comprising the steps of: 

converting speech from the user telephone to conmiands; 

determining the information system to be accessed; 

converting the text to commands recognizable by the information system; 

forwarding the converted commands to the information system; 

receiving data from the information system; 

detecting the form of the data from the information system; 

converting non-speech data from the information system into speech; 

forwarding the speech data to the user telephone; 

storing information relating to the current state of the system; 

receiving a conamand from the user telephone signaling that the user telephone has 
received imintelligible words; 

ceasing communication to the user telephone; 

restarting communication to the user telephone at a point a specified number of words 
back from the point at which the communication ceased; 

forwarding the first specified number of words by spelling the words out; and 
continuing to forward the remainder of the data. 
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55. (Amended) A method for providing data from one or more information systems 
to a user telephone, comprising the steps of: 

converting speech from the user telephone to commands; 
determining the information system to be accessed; 
converting the text to commands recognizable by the information system; 
forwarding the converted commands to the information system; 
receiving data from the information system; 
detecting the form of the data from the information system; 
converting non-speech data from the information system into speech; 
forwarding the speech data to the user telephone; 
storing information relating to the current state of the system; 
detecting the language in which the conmiands from the user telephone are received; 
detecting the language of the data received from the information system; and 
converting the data from the information system into the language in which conmiands 
from the user telephone are received. 

56. The method of claim 55, wherein detecting the language of the data received from 
the information system further comprises detecting more than one language within a single piece 
of data. 

REMARKS 

Attached is a marked-up version of the changes being made by the current amendment. 
Assuming the Intemational Preliminary Examination Report (IPER) will be in accordance with 
the written opinion, the IPER will state that the criteria of novelty, inventive step (non- 
obviousness) and industrial applicability, as defined in PCX Article 33(1) to (4), have been 
satisfied for all claims presented by way of this preliminary amendment. Xhe claims for which 
the written opinion indicated the criteria were not met were cancelled without prejudice. Claims 
5 and 49 have been amended to correct formalities discussed in the written opinion. Claims 47, 
52 and 54-55 have been converted to independent form. 
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Applicant submits that all of the claims are now in condition for allowance, which action 
is requested- 
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2200 Sand Hill Road, Suite 100 
Menlo Park, CA 94025 
Telephone: (650) 322-5070 
Facsimile: (650) 854-0875 



Respectfully submitted, 




Katherine Kelly Eutton 
Reg. No. 46,333 



50054833.doc 



Applicant : Paul Edmonds et^^ 
Serial No. : As yet unknown 
Filed : July 23, 2001 
PCT Serial No.: PCT/USOO/1547 
PCT Filing Date: 21 January 2000 
Page : 15 



AtSfney's Docket No.: 09872-002003 



Version with markings to show changes made 

In the claims: 

Claims 1-4, 41-46, 51, 53 and 57-60 have been cancelled. 
Claims 5, 47, 49, 52 and 54-55 have been amended as follows: 

5. (Amended) A universal interface for accessing one or more information systems 
from a user telephone, the universal interface comprismg: 

an input converter for converting input from the user telephone to commands; 

an interface control module coupled to the input converter for receiving the commands 
from the input converter; determining one of the information systems to be accessed; converting 
the commands to commands recognizable by the information system; forwarding the converted 
commands to the information system; receiving data from the information system; detecting the 
form of the data from the information system; and storing information relating to a current state 
of the system; 

a speech-to-text routing switch coupled to the interface control module for receiving data 
from the information system and control data from the interface control module; 

a speech-to-command converter coupled to the interface control module for converting 
speech to commands, wherein the speech-to-command converter is coupled to the speech-to- 
[command] text routing switch to receive speech and to forward conmiands to the interface 
control module; 

an output switch coupled to the interface control module and the speech-to-text routing 
switch for receiving speech from the speech-to-text routing switch for receiving a control input 
from the interface control module, and for forwarding speech from the speech-to-text routing 
switch to the user telephone; and 

a text-to-speech converter coupled to the output switch for receiving text from the 
interface control module, converting the text to speech, and forwarding the speech to the output 
switch to deliver speech to the user telephone. 
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47. (Amended) [The method of claim 4 1 , fiirtherl A method for providing data from 
one or more informati on systems to a user telephone, comprising the steps of : 
converting speech from the user telephone to text; 
determining the information system to be accessed: 
converting the text to commands recognizable by the information system; 
forwarding the converted commands to the information system; 
receiving data from the information system: 
detecting the form of the data from the information system: 
converting no n-speech data from the information system into speech: 
forwarding the speech data to the user telephone: 
storing inform ation relating to the current state of the system: and 
integrating and synchronizing (i) a database of a personal information manager, (ii) a 
database of a personal digital assistant, and (iii) a database residing in a universal interface, by: 

receiving data from the personal digital assistant; 

receiving data from the universal interface; 

detecting a synchronization event, wherein the event is triggered by a request for 
synchronization of the database of the personal digital assistant v/ith the database of a personal 
information manager; 

transmittmg data, via an electronic mail system, to the interface control module; 

and 

updating the data in each of the databases to reflect the most recent data entered 
into any one database. 

49. (Amended) The method of claim 4[1]8, fiirther comprising sending the data from 
the information system to the universal interface over the Internet. 



52. (Amended) [The method of claim 4U A method for providing data from one or 
more infor mation systems to a user telephone, comprising the steps of : 
converting spe ech from the user telephone to commands: 
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determining the information system to be accessed: 

converting the text to commands recognizable by the information system: 

forwarding the converted commands to the information system: 

receiving data from the information system: 

detecting the form of the data from the information system: 

converting non-speech data from the information system into speech: 

forwarding the speech data to the user telephone: and 

storing information relating to the current state of the system, wherein storing 
information relating to the current state of the system further comprises the steps of determining: 
whether the voice commands are being received from a user telephone; 
the information system to be accessed; 

whether the voice commands, after being converted to text, have been converted 
into commands recognizable by the information system; 

whether the converted commands have been forwarded to the information system; 
whether data has been received from the information system; 
whether data from the information system is speech or text; 
the state of the speech-to-text routing switch; and 
the state of the output switch. 

54. (Amended) [The method of claim 41 , further] A method for providing data from 
one or more information systems to a user telephone, comprising the steps of : 
converting speech from the user telephone to commands: 
determining the information system to be accessed: 
converting the text to commands recognizable by the information system: 
forwarding the converted commands to the information system: 
receiving data from the information system: 
detecting the form of the data from the information system: 
converting non-speech data from the information system into speech: 
forwarding the speech data to the user telephone: 
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Storing information relating to the current state of the system; 
receiving a command from the user telephone signaling that the user telephone has 
received unintelligible words; 

ceasing communication to the user telephone; 

restarting communication to the user telephone at a point a specified number of words 
back from the point at which the communication ceased; 

forwarding the first specified number of words by spelling the words out; and 
continuing to forward the remainder of the data. 

55. (Amended) [The method of claim 41, further] A method for providing data from 
one or more information systems to a user telephone, comprisin g the steps of : 

converting speech from the user telephone to commands: 

determining the information system to be accessed: 

converting the text to commands recognizable by the information system: 

forwarding the converted commands to the information system: 

receiving data from the information system: 

detecting the form of the data from the information system: 

converting non-speech data from the information system into speech: 

forwarding the speech data to the user telephone: 

storing information relating to the current state of the system: 

detecting the language in which the commands from the user telephone are received; 

detecting the language of the data received from the information system; and 

converting the data from the information system into the language in which commands 
from the user telephone are received. 



Page 1 of 1 




Hans R. Troesch 
Fish & Richardson 
2200 Sand Hill Road 
Suite 100 

Menio Park, CA 94025 



01/21/2000 01/21/1999 
CONFIRMATION NO. 3486 

371 

ABANDONMENT/TERMINATION 
LETTER 

lliilllllliiiliiilli^^^^ 

•OC000000007482949* 



Date Mailed: 02/15/2002 



NOTIFICATION OF ABANDONMENT 



The United States Patent and Trademark Office in its capacity as an Elected Office (37 CFR 1 .495), has made 
the following determination: 

• Applicant has failed to provide the full U.S. Basic National Fee by 30 months (37 CFR 1 .495(b)(2)). 

• No deposit account. DOCKETED BY PRACTICE SYSTEMS 



ACTION: 



BASE: 
DUE: 



DEADUNE: 



INITIAI 



Therefore the above identified application failed to meet the requirements of 35 U.S.C. 371 and 37 CFR 1 .495. 
and is ABANDONED AS TO THE UNITED STATES OF AMERICA. 



BARBARA A CAMPBELL 



Telephone: (703) 305-3631 

PART 1 - ATTORNEY/APPLICANT COPY 

FORM pcT/DO/EO/909 (371 Abandonment Notice) \ Docketed By Billing Secretary 

Due Date: 
Deadline: 
Initials: ^ 



PTO/SB/64/PCT (10-00) 
Approved for use through 10/31/2002. OMB 0651-0031 
U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE 
Under the Paperwork Reduction Act of 1995. no persons are required to respond to a coHection of information unless it displays a valid OMB control number. 



PETITION FOR REVIVAL OF AN INTERNATIONAL APPLICATION FOR PATENT 
DESIGNATING THE U.S. ABANDONED UNINTENTIONALLY UNDER 37 CFR 1.137(b) 



Docket Number (Optional) 
09872-002003 



First named inventor: Paul EDMONDS, et al. 

International (PCT) Application No.: PCT/USOO/01547 U.S. Application No.: 09/889,911 
Filed: July 23, 2001 (if known) 

Title: UNIVERSAL INTERFACE FOR VOICE ACTIVATED ACCESS TO 
MULTIPLE INFORMATION PROVIDERS 

Attention: PCT Legal Staff 
Box PCT 

Assistant Comnnissioner for Patents 
Washington, D.C. 20231 

The above-identified application became abandoned as to the United States because the fees and documents 
required by 35 U.S.C. 371(c) were not filed prior to the expiration of the time set in 37 CFR 1.494(b) or (c) or 
1.495(b) or (c) as applicable). The date of abandonment is the day after the date on which the 35 U.S.C. 371(c) 
requirements were due. See 37 CFR 1.494(g) or 1.495(h). 

APPLICANT HEREBY PETITIONS FOR REVIVAL OF THIS APPLICATION 

NOTE: A grantable petition requires the following items: 

(1) Petition fee 

(2) Proper reply 

(3) Terminal disclaimer with disclaimer fee-required for all international applications having 
an international filing date before June 8, 1995; and 

(4) Statement that the entire delay was unintentional. 

1 . Petition fee 

□ Small entity - fee $ (37 CFR 1.1 7(m)). Applicant claims small entity status. 

See 37 CFR 1.27. 

\S Other that small entity - fee $__1280_._(37 CFR 1.1 7(m)) 

2. Proper reply 

A. The proper reply (the missing 35 U.S.C. 371(c) requirement(s) in the form of 

payment of a^^^ (identify type of reply): 

charge deposit account. 

□ has been filed previously on . 

is enclosed herewith. 



[Page 1 of 2) 

Burden Hour Statement: This form is estimated to take 1.0 hours to complete. Time will vary depending upon the needs of the individual case. Any comments on 
the amount of time you are required to complete this form should be sent to the Chief Information Officer, U.S. Patent and Trademark Office Washington DC 
20231 . DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Assistant Commissioner for Patents. Washington, DC 20231 . 



PTO/SB/64/PCT (10-00) 
Approved for use through 10/31/2002. OMB 0651-0031 
U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE 
Ur>der the Paperwork Reduction Act of 1995. no persons are required to respond to a collection of information unfess it displays a valid OMB control number 



3. Terminal disclaifner with disclaimer fee 

E^Since this international application has an International filing date on or after June 8, 1995. no 
terminal disclaimer is required. 

□ A terminal disclaimer (and disclaimer fee (37 CFR 1 .20(d)) of $ for a small entity or 

$ for other than a small entity) disclaiming the required period of time is enclosed herewith 

(see PTO/SB/63). 

4. Statement. The entire delay in filing the required reply from the due date for the required reply until the 
filing of a grantable petition under 37 CFR 1.137(b) was unintentional. 



WARNING: Information on this form may become public. Credit card information should not 
be included on this form. Provide credit card information and authorization on PTO-2038. 



Date 



Telephone 

Number: ( 650)839-5070 




signature 

Katherxne Kelly mtton, Reg. No - 46, 33^ 

Typed or printed name 
Fish & Richardson P. C, 

Address 

500 Arguello Street, Suite 500 
Redwood City, ca 9A063 — 



Enclosures; □ Response 

Fee Payment 
O Terminal Disclaimer Form 

^ Filing Fee and Additional C laims Fee 
XX Postcard 

Please apply any other charges or credits to Deposit Account 
No. 06-1050. 



[Page 2 of 2] 




~1 jif^-^^-a 



AT^/I UIPOSTAGE 

y , 3 ME TEn * * ' - 



>787:331 1 



Fish & Richardson P.C. 
60 South Street 
3300 Dain Rauscher Plaza 
Minneapolis, MN 55402 





Express /ilail'L^^ V A;=%0>.'-L^ /^f^ 

^'No ^^v • :c : - - " :^ ^; AnQRNEY. DOCKET NO.: U 1 (S "tcA v^^'^ ^ 
p^The;Patent and Trademarl^ffice date star^ dqt^ of: ; ^ 

^gMnV|jApplirntinn Ol f K S] ^11 { - " 

J;: Transmittal Letter ; Pages . : □ Petition for Extension of Time. . 

f n^/^^ Pages Status Inquir/ ; - / f ; V' ; 

f Mainfteriance Fee ^ ; i v □ Request Certificate of Cbnrection \ T;^^^ 

Check - :' ' □ Notice of Appeal ^ 

ujssue Fee'QF^quest pqte^^ r / , v . I - 

l:^ b^brawi Sheets Informal T " V^'}.^^^ 

I P Response to Notice of Missing Parts ^ \ 

[ □ dpnhbined Declaration and Power of Attorney Pages _Signed - 

i^Unsigneci''Vi^^r'/^^ ■ ■ ■ ^'y'y.^ ' ■•■ \''-"' i ' ■ ' - -i^'^'?^;*^^^; 

Up Assianrii^nf ^^V ' ■ Pages-^ □ Recordation Form Cover Sheet Pages - 
I □ Small Entity Statement ; ^ V ' : 

: n information Disclosure Statement • Pages ^ V J 

U □ PTOfDrm 1 449 __ Pages □ Prior Art References - No. of References " '- ' - . 



■ ' I 



BB$T AVAILABLE COPY 



